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C.    Costs, Benefits, and Effectiveness  (Continued)

Program Effects: How effective 1s Title VII? This is a difficult question
to answer. The large majority of project evaluations are so flawed in
their research design that they cannot be used to assess the impact of
the program. Each Title VII grantee is required by law to conduct a
project evaluation. For the 1980-81 school year, there should have been
550 evaluation reports; there were 355. Of these, only 84 were found to
meet minimum levels of scientific quality to explain whether or not the
program had an effect on the participants (Ell). OBEMLA is taking steps
to improve evaluation quality.

The first (and only) national evaluation of Title VII found in 1975 that
Title VII had no effect on math performance and a negative effect on
English (E10). More recently, in a review of the evaluation literature,
of both Title VII and non-Title VII bilingual education programs, Baker
and de Kanter (E12.13) found mixed results for bilingual education. For
both English and math, some programs achieved gains,some were ineffective,
but some had negative effects.

In a survey of teachers in Title VII projects, great or very great project
impacts were reported 1n the following areas by percentage of teachers:
Spoken English (58 percent), Cultural Awareness (70 percent), Academic
Skills (65 percent), Reading (62 percent), Native Language (69 percent),
Self-image (81 percent), and Attitude Toward School (79 percent) (El).

Capacity Building. One of the major intents of the basic grant program
is to provide limited, short-term intervention 1n an LEA to Improve the
LEA's capacity for meeting the needs of limited English proficient stu-
dents. Many LEAs have received Title VII assistance for considerable
periods: 314 (40 percent of all LEAs receiving grants) LEAs have received
Title VII grants for six years or more; 111 LEAs have received grants for
ten years or more.

To assess probability of 1nst1tut1onal1zat1on, the Title VII project and
district staff were asked in a recent stucty 1f the project was effectively
accomplishing its goals and meeting local needs. Almost three-quarters
of the superintendents who were Interviewed believed the project was
effectively accomplishing its goals to a great or very great degree. In
addition, approximately two-thirds of teachers considered the project to
be a definite advantage or a vital addition to the district's educational
system. However, district administrators were concerned about their
ability to continue the project without Federal funding. Seventy-six per-
cent of superintendents, 82 percent of Federal program coordinators, and
72 percent of principals said that bilingual education services would be
reduced or dropped 1f Title VII funding was reduced or discontinued (El). directors Indicated th^t they had Imp ene ted
